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DETAILED ACTION 

1. Applicant's response to the last Office Action, filed on July 27, 2007 has been 
entered and made of record. 

Remarks 

2. Applicant's argument with respect to claims 1-22, have been fully considered, but 
they are not persuasive. 

a. Applicant argues that Zhang fails to teach or suggest, "cropping said plurality 
of digital photos to generate images of isolated objects of interest, applying an object 
recognition algorithm to determine the similarity of isolated objects with a reference 
model, and displaying a plurality of objects arranged as a function of the determined 
similarity". Furthermore, Zhang fails to teach or suggest, "receiving user input to 
associate said objects with a particular classification. 

However, in response to applicant's arguments, Examiner would like to point out 
that claim language is given its broadest reasonable interpretation. In the instant case, 
Zhang clearly shows in figure 4 an exemplary set of facial feature components for 
annotations faces in digital images. The facial components features are each contained 
within one or more rectangular. Zhang clearly means by the facial component features 
the isolated objects from the face such as the eyes, noise, and mouth (paragraph 
[0046], line 1-12). Zhang clearly shows the cropping of digital image to generate of face 
appearance features which means the isolated objects of the face such as the eyes, 
mouth, and noise (paragraph [0083], line 1-4), and applying an object recognition 
algorithm, where a set of object detectors is derived from a robust algorithm are utilized 
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to detect each facial component in the corresponding area (paragraph [0046], line 7-10), 
the facial components means clearly the isolated object such as eyes, noise, and 
mouth. Also, Zhang discloses the determining of the similarity of isolated objects with a 
reference model, where the candidate name list is sorted according to the similarity 
measures between unlabeled and labeled faces (the labeled faces is read as the 
reference model) (paragraph [0076], line 6-8). Furthermore, the Examiner interpreted 
that it is obvious to display the plurality of objects arranged as a function of the 
determined similarity, since the candidate name list is sorted according to the similarity 
measures, and it's read the broad claim language calls for "using a monitor to display 
digital images" (paragraph [0036], line 3-4). Finally, Zhang clearly shows the receiving 
of user input to associate the objects with the particular classification, where the user 
explicit annotation of faces in digital images (paragraph [0076], line 1-2), (the faces are 
read as objects) and associating the candidate name list with multi-class classification 
task (paragraph [0076], line 11-13). 

Therefore, the rejection of claim language based on Zhang is good and should 
be sustained. 

Claim Rejections - 35 USC $112 

3. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 
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4. Claims 1 and 12 rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. 

Claim 1, line 6, and claim 12, line 7, recite the limitation "a plurality of objects". 
There is insufficient antecedent basis for the limitation in the claims. The "plurality of 
objects" is not introduced before. It is unclear if this limitation of the claims is intended to 
refer to the "objects" on line 2 of claim 1 or to the "isolated objects" on line 3 of claim 1 . 
However, "a plurality of objects" differs from the "objects", and the "isolated objects". 

Claim Rejections - 35 USC $ 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in a patent granted on an application for patent by another filed in the 
United States before the invention thereof by the applicant for patent, or on an international application 
by another who has fulfilled the requirements of paragraphs (1), (2), and (4) of section 371(c) of this 
title before the invention thereof by the applicant for patent. 

6. Claims 1,3-5,10,12,14-16, and 21 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Zhang et al. (US 2004/0264780). 

(1) Regarding claims 1 and 12: 

Zhang et al. disclose a computer-based method and system for organizing digital 
photos (paragraph [0004], line 1-2), comprising: 

extracting objects of interest from a plurality of digital photos (paragraph [0042], 
line 6-7, and paragraph [0043], line 1-9); 
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cropping said plurality of digital photos to generate images of isolated objects of 
interest (paragraph [0043], line 1-9), (the face appearance features are read as the 
isolated objects of interest); 

applying an object recognition algorithm (paragraph [0046], line 7-10) to 
determine the similarity of isolated objects (paragraph [0051], line 1-4) with a reference 
model (paragraph [0076], line 6-8), (the labeled faces are read as a reference model); 

displaying a plurality of objects arranged as a function of the determined 
similarity (paragraph [0076], line 6-7; and paragraph [0036], line 3-4), (the Examiner 
interpreted that it's obvious to display the plurality of objects arranged as a function 
since the candidate name list is sorted according o the similarity measures); and 

receiving user input (paragraph [0076], line 1-2) to associate said objects (the 
faces are read as objects) with a particular classification (paragraph [0076], line 11-13), 
(the annotating of individual faces as multi-class classification is read as the associating 
of the objects to a particular classification). 

(2) Regarding claims 3 and 14: 

Zhang et al. further disclose the method and system (paragraph [0004], line 1-2), 
where the objects are faces (paragraph [0017], line 1, and line 8-9). 
° (3) Regarding claims 4 and 15: 

Zhang et al. further disclose the method and system (paragraph [0004], line 1-2), 
where isolated faces are displayed in a view that includes an area surrounding the face 
(Fig. 3 and 4, paragraph [0043], line 3-4). 
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(4) Regarding claims 5 and 16: 

Zhang et al. further disclose the method and system (paragraph [0004], line 1-2) 
comprising annotating image objects based on said classification (paragraph [0042], 
line 1-3; and paragraph [0076], line 11-13). 

(5) Regarding claims 10 and 21: 

Zhang et al. further disclose the method and system (paragraph [0004], line 1-2), 
where the step of displaying a plurality of objects (paragraph [0036], line 3-4) displays 
the objects in order of similarity to the reference model (paragraph [0076], line 6-8), (the 
labeled faces is read as reference mode). 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

8. Claims 2,6-8,13, and 17-19 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Zhang et al. in view of Hanna et al. (US 6,714,665). 

(1) Regarding claims 2 and 13: 

Zhang et al. disclose the entire subject as described in claim 1 above. 
Zhang et al. do not explicitly mention the repeating of the recognition algorithm 
and the display as more objects are grouped as belonging to a certain identity. 

Hanna et al., in analogous environment, teaches a recognition system which 
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obtains and analyze images, where repeating the step 1530 (column 21, line 19), (the 
repeating of step 1520 is read as the same concept as repeating the steps of 
recognition algorithm and the display). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to use the system of Hanna et al., where repeating the step 1520, 
in the method of Zhang et al. in order to identifying objects or individuals in a passive 
way that is both fast and accurate (column 1 , line 51-53). 

(2) Regarding claims 6 and 17: 

Zhang et al. disclose the entire subject as described in claim 1 above. 

Zhang et al. do not explicitly mention the controlling of photo presentation based 
on the classification. 

Hanna et al., in analogous environment, teaches a recognition system which 
obtains and analyze images, where controlling of photo presentation based on the 
classification (column 12, line 6-8, and line 18-22), (the photo presentation is read as 
the image information of a person, and the use of control process is read as the same 
concept as the controlling photo presentation). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to use the system of Hanna et al., where controlling a photo 
presentation, in the method of Zhang et al. in order to identifying objects or individuals in 
a passive way that is both fast and accurate (column 1 , line 51-53). 

(3) Regarding claims 7 and 18: 

Zhang et al. disclose the entire subject as described in claim 6 above. 
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Furthermore, Zhang et al. disclose the method, where labeling the multiple faces 
(paragraph [0022], line 1-6, and paragraph [0074], line 6-8), (the labeling of multiple 
faces is read as the same concept as displaying a label for isolated objects of interest). 

Zhang et al. do not explicitly mention the controlling of photo presentation based 
on the classification. 

Hanna et al., in analogous environment, teaches a recognition system which 
obtains and analyze images, where controlling of photo presentation based on the 
classification (column 12, line 6-8, and line 18-22), (the photo presentation is read as 
the image information of a person, and the use of control process is read as the same 
concept as the controlling photo presentation). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to use the system of Hanna et al., where controlling a photo 
presentation, in the method of Zhang et al. in order to identifying objects or individuals in 
a passive way that is both fast and accurate (column 1 , line 51-53). 

(4) Regarding claims 8 and 19: 

Zhang et al. disclose the entire subject as described in claim 1 above. 
Zhang et al. do not explicitly mention the controlling of a zoom function based on 
the classification. 

Hanna et al., in analogous environment, teaches a recognition system which 
obtains and analyze images, where controlling the zoom function (column 11, line 12- 
13) based on the classification (column 12, line 6-9). 
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It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to use the system of Hanna et al., where controlling the zoom 
function, in the method of Zhang et al. in order to identifying objects or individuals in a 
passive way that is both fast and accurate (column 1 , line 51-53). 

9. Claims 9 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Zhang et al. and Hanna et al., as applied to claim 6 above, and further in view of Mathe 
(US-PGPUB 2005/0060636). 

Zhang et al. and Hanna et al. disclose all the subject matter as described in claim 
6 above. 

Zhang et al. and Hanna et al. do not explicitly mention that the photo 
presentation is slide presentation. 

Mathe, in analogous environment, teaches a digital photo Album, where the 
Photo presentation is slide presentation (paragraph [007], line 9-11). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to use the system of Mathe, where the Photo presentation is slide 
presentation, in the method of Zhang et al. in order to solve the problem of printing 
pictures by reducing cost, and it is much faster and easier to learn to use than a 
computer (paragraph [0007], line 11-13). 

10. Claims 11 and 22 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Zhang et al. in view of Neff et al. (US 6,751 ,780). 
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Zhang et al. disclose all the subject matter as described in claim 1 above. 

Zhang et al. do not explicitly mention that the user input drags an image of an 
object of interest into a display area associated with the classification. 

Neff et al., in analogous environment, teaches a user interface for initiating the 
export of an optimized scanned document using drag drop, where the user input drags 
an image of an object of interest into a display area (See the Abstract), (the display area 
is read as scanner window) associated with the classification (column 5, line 48-51). 

It would have been obvious to one having ordinary skill in the art at the time the 
invention was made to use the system of Neff et al., where the user input drags an 
image of an object of interest into a display area, in the system of Zhang et al. in order 
to click on a selected region in a preview scan of a document and drag it to an open 
application or a desktop to launch an optimized final scan of the selected region 
(column 1, line 56-59). 

Conclusion 

1 1 . THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
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extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 



Contact Information: 
12. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Amara Abdi whose telephone number is (571) 270- 
1670. The examiner can normally be reached on Monday through Friday 7:30 Am to 
5:00 PM E.T.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Wu Jingge can be reached on (571) 272-7429. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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